Device and method for capturing images and switching images through a drag operation

ABSTRACT

An image capturing apparatus that includes one or more image sensors configured to capture a plurality of images and store the captured images in a memory. The apparatus also includes a circuitry that detects an input trigger and continues to capture new images in response to the trigger. The numbers of new images captured are equal in magnitude to half the magnitude of the capacity of the memory. The first new image captured after detecting the trigger is tagged as a reference image. In response to the number of new images captured, the sensors are deactivated and the reference image is displayed immediately on a display panel. On detecting an input operation, the apparatus displays a target image from the plurality of images captured in a quick and efficient manner.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. application Ser. No.17/060,105, filed Oct. 1, 2020, which is a continuation of U.S.application Ser. No. 16/532,508, filed Aug. 6, 2019, (now U.S. Pat. No.10,812,726), which is a continuation of U.S. application Ser. No.15/081,230, filed Mar. 25, 2016, (now U.S. Pat. No. 10,419,677), whichis a continuation of U.S. application Ser. No. 13/907,214, filed May 31,2013 (now U.S. Pat. No. 9,319,589), the entire contents of each areincorporated herein by reference.

BACKGROUND Field of the Disclosure

This disclosure relates to a method of capturing a series of successiveimages and efficiently selecting a desired image from the series ofcaptured images.

DESCRIPTION OF THE RELATED ART

Mobile devices, such digital still-cameras, phones and tablets areexamples of devices that are adapted to capture a series of images andperform certain processing based on a user's input.

Traditionally, while using such devices, it is not easy to capture aphotograph of an image at a desired time instant. This occurs primarilydue to the inherent time-lag in a user's operation such as activating ashutter control or the like. Furthermore, a delay associated with theprocessing of an image makes it difficult for the user to capture thedesired image at a certain time instant. Thus, a series of images isusually captured in a fixed time interval which starts before activatinga shutter operation and ends at a pre-determined time after theactivation of the shutter button. The images captured in this manner arethen displayed in a pre-determined fashion (either displaying the lastimage captured or the first image captured of the series of images) anda particular image is selected based on the user's input.

However, to select the desired image, a series of complicated userinstructions is usually performed. The selection process may betime-consuming and thus provides a discontented experience to the user.Accordingly, there is a requirement to select a desired image from aseries of images in an efficient and rapid manner.

SUMMARY

Devices and methods for successively capturing a plurality of continuoustime-stamped images and efficiently selecting a desired image from theplurality of images are discussed herein.

According to one exemplary embodiment, the disclosure is directed to animage capturing apparatus comprising: comprising: one or more imagesensors configured to capture a plurality of images at a capture rate; amemory configured to store the plurality of captured images; andcircuitry configured to: detect an input trigger, capture a number ofnew images in response to detecting the input trigger, the number of newimages being equal to a predetermined value, tag a first image, of thenumber of new images captured after detecting the input trigger, as areference image, deactivate the sensor in response to capturing thenumber of new images, and control a display panel to display thereference image in response to deactivating the sensor.

According to another exemplary embodiment, the disclosure is directed toa method performed by an image capturing apparatus, the methodcomprising: capturing, by one or more image sensors, a plurality ofimages at a capture rate; detecting, by circuitry, an input trigger andcontinuing to capture a number of new images following the input triggerdetection, the number of new images being equal to a predeterminedvalue; tagging, by the circuitry, a first image, of the number of newimages captured after the detecting, as a reference image; deactivating,by the circuitry, the one or more image sensors in response to capturingthe number of new images; and controlling a display panel, by thecircuitry in response to deactivating the one or more sensors, todisplay the reference image thereon.

According to another exemplary embodiment, the disclosure is directed toa non-transitory computer-readable medium including instructions storedtherein, which when executed by one or more processors, cause the one ormore processors to execute a method comprising: capturing, by one ormore image sensors, a plurality of images at a capture rate; detecting,by circuitry, an input trigger and continuing to capture a number of newimages following the input trigger detection, the number of new imagesbeing equal to a predetermined value; tagging, by the circuitry, a firstimage, of the number of new images captured after the detecting, as areference image; deactivating, by the circuitry, the one or more imagesensors in response to capturing the number of new images; andcontrolling a display panel, by the circuitry in response todeactivating the one or more sensors, to display the reference imagethereon.

The foregoing general description of the illustrative implementationsand the following detailed description thereof are merely exemplaryaspects of the teachings of this disclosure, and are not restrictive.

BRIEF DESCRIPTION OF THE DRAWINGS

A more complete appreciation of the invention and many of the attendantadvantages thereof will be readily obtained as the same becomes betterunderstood by reference to the following detailed description whenconsidered in connection with the accompanying drawings, wherein.

FIG. 1 illustrates schematically an exemplary digital camera device;

FIG. 2A-FIG. 2G illustrate a non-limiting example depicting a series oftime dependent images;

FIG. 3 illustrates an exemplary ring buffer memory according to oneaspect of the present disclosure;

FIG. 4 illustrates a triggering operation performed on the cameradevice;

FIG. 5 shows a non-limiting example depicting a user interface that isused to select a desired image;

FIG. 6 shows an input operation to select a desired image according toan embodiment of the present disclosure;

FIG. 7 shows an exemplary three-dimensional coordinate axis of thecamera device and a corresponding three dimensional reference axissystem;

FIG. 8 illustrates an exemplary switching operation performed to selecta desired image from a series of continuous images;

FIG. 9A and FIG. 9B show a non-limiting example of images displayed onthe display panel during a capturing mode;

FIG. 10 illustrates an exemplary switching operation performed on theimages as depicted in FIG. 9B;

FIG. 11A and FIG. 11B illustrate exemplary direction indicators that areused in a viewing mode of the camera device;

FIG. 12 shows another input operation to select a desired imageaccording to another embodiment of the present disclosure;

FIG. 13 is an exemplary flowchart illustrating the steps performed bythe camera device according to an embodiment of the disclosure;

FIG. 14 is an exemplary flowchart illustrating the steps of displayingan image on the display panel according to an embodiment of the presentdisclosure;

FIG. 15 is an exemplary flowchart illustrating the steps of displayingan image on the display panel according to another embodiment of thepresent disclosure;

FIG. 16 shows an exemplary interface to select a desired image accordingto a another embodiment of the present disclosure;

FIG. 17A-FIG. 17D depict an exemplary touch operation to select adesired image frame;

FIG. 18A and FIG. 18B show another exemplary touch operation to select adesired image;

FIGS. 19A-19C show another example depicting a touch operation to selecta desired image from a series of captured images;

FIG. 20 is an exemplary flowchart illustrating the steps of displayingan image using the touch interface according to an embodiment of thepresent disclosure; and

FIG. 21 is an exemplary flowchart illustrating the steps of displayingan image using the touch interface according to another embodiment ofthe present disclosure.

DETAILED DESCRIPTION

Referring now to the drawings, wherein like reference numerals designateidentical or corresponding parts throughout the several views.

FIG. 1 illustrates schematically an exemplary digital camera device 100.The digital camera 100 can include an image sensor 10, a memory 20, animage processing unit 30, a control unit 40, an inclination sensor 50, atouch panel 60, a display panel 70, and a communication bus 80.

The image sensor 10 may include an optical lens and an image pickupelement such as a CMOS sensor or a charged coupled device (CCD) sensor.The image sensor projects the image of the object to be photographed byusing an optical lens that passes the image onto an image pickup elementand acquires the data thereof.

The control unit 40 may comprise one or more processors that controleach element of the digital camera device 100 based on data detectedeither by a touch panel 60 or an input received from the inclinationsensor 50. Thus, the inclination sensor and a touch sensor (configuredto detect a touch on the touch panel 60) provide various interfaces toaccept input commands in order to perform some processing on the imagesthat are captured by the camera device 100. The controller may furtherexecute instructions stored in memory 20 wherein the memory 20 may be anon-transitory computer-readable medium having instructions storedtherein for controlling the camera device 100. Further, the controllermay utilize one or more processors for executing the instructions thatare stored in memory 20. The control unit may also be configured toperform functions on captured images such as an autofocus function (AF)or an auto exposure function (AE).

According to an embodiment of the present disclosure the image sensor 10may include a function which enables the camera device 100 to capture aseries of images at a fixed frame (image) rate in a fixed total of time.The memory unit 20 can include an image memory which is utilized tostore the data of the images captured by the image sensor 10. Further,the memory 20 may also include a dedicated memory unit that stores acomputer program that is used by the control unit 40 in processing acertain set of instructions. According to an embodiment of the presentdisclosure, the image memory may be a buffer memory such as a ringbuffer which stores image frames in a sequential cyclic manner. Further,the image memory may be a nonvolatile memory such as a read-only memory(ROM), a flash memory, a ferroelectric RAM (FRAM) or the like.

The image processing unit 30 performs storage functions, readoutfunctions, or the like to memory unit 20, of image data that is capturedby the image sensor 10. Accordingly, the image processing unit 30 canalso display the captured image onto the display unit (viewer) 70. Thecontrol unit 40 is a central processing unit (CPU), that performs theoverall control and management of the digital still camera device 100.The CPU achieves the desired control and process by reading andexecuting the computer program that is stored in memory 20.

The inclination sensor 50 detects an inclination of the camera device100 (e.g., as a result the inclination of the display panel 70) and maybe a triaxial acceleration sensor, a gyro, a tilt meter, a tiltindicator, a slope sensor, a gradient meter or the like. According to anembodiment of the present disclosure the inclination sensor 50 isconfigured to measure inclinations (tilts) in both the positive and thenegative direction (to be described later with reference to FIG. 7 ).

The camera device 100 may include a display unit, 70. The display unit70 may be, for example, a liquid crystal display (LCD) panel, an organicelectroluminescent (OLED) display panel, a plasma display panel or thelike. The display unit 70 may display an image that is captured by theimage sensor or may also be configured to function as a viewfinder whichdisplays the image of an object to be photographed.

The digital camera device 100 may include a touch panel 60 that candetect a touch operation on the surface of the display 70. For example,the touch panel 60 can detect a touch operation performed by aninstruction object such as a finger or a stylus. Touch operations maycorrespond to a user's input such as a selection of an icon that isdisplayed on the display panel 70. The touch panel 60 may be anelectrostatic capacitance type device, a resistive type touch paneldevice or other such type of devices that are used for detecting a touchon the display panel.

The touch panel 60 may perform processing related to touch operationclassification. For example, the touch panel 60 may assign apredetermined function to be performed when a tap operation is detected.Similarly, the touch panel unit may analyze a touch operation in whichthe instruction object makes continuous contact with the display panel70 while moving the instruction object around the display, e.g., a swipeor a drag operation. The touch panel 60 may output a signal based on aclassification of the touch operation performed. The signal may, forexample, include information indicating the touch operationclassification, the location on the display panel 70 where the touchoperation was performed and the operation to be performed based on thetouch operation. Alternatively, the touch panel 60 may also beconfigured to detect an intensity of a user's touch and to use thecorresponding intensity to select a particular image from a series oftime-stamped images. The digital still camera device 100 can include acommunication bus 80 that may include a control line (CL) and a dataline (DL) as internal bus lines for communication. The CL can be used totransmit control data from the control unit 40. The DL may be used fortransmission of data corresponding to an image or the like, throughoutthe various elements of the camera device 100.

The digital still camera device 100 may optionally include a shortdistance wireless communication unit. The short distance wirelesscommunication unit may enable the camera device 100 to communicatewirelessly with other devices over a network such as the internet, alocal area network or a wide area network (WAN). The communication unitmay include an antenna such as a Wi-Fi transceiver to achieve wirelessconnectivity. The wireless connectivity enables the camera device 100 totransfer a selected (desired) image captured by the image sensor toanother mobile device or a laptop device or the like. Note that theimaging device as described above is not restricted necessarily to adigital still camera. For example, portable devices, such as a smartphone, a tablet device or the like that include the functionality of theabove described digital camera may also suffice.

FIG. 2A to FIG. 2G illustrate a non-limiting example depicting a seriesof images that are captured by the camera device 100 in a fixed intervalof time. Specifically. FIGS. 2A to 2G depict a chameleon preying on aninsect. While capturing images, wherein the object continuously changeswith respect to time, it is usually difficult to capture the object at adecisive instant of time. For example, it is typically difficult tocapture an image that depicts the chameleon preying on the insect asshown in the image of FIG. 2C. Furthermore, even if a series of imagesare captured wherein one of the images corresponds to the desired image,it is typically very cumbersome to select the desired image from theseries of images. This usually requires many input instructions toselect the desired image. Note that the object to be photographed ismoving with respect to the still camera (high-speed movement). In whatfollows, the example of the chameleon is used to explain variousembodiments of the present disclosure. Note that the example of thechameleon is in no way limiting the scope of the present disclosure.Specifically, a high-speed image processing capability of the digitalstill camera device 100 may be applicable to any photographed object.

FIG. 3 illustrates an exemplary ring buffer memory 23 according to anembodiment of the present disclosure. The ring buffer memory 23 is acircular shaped memory unit which including n-memory slots, each capableof storing one frame of the captured image. The value of n is preferablya positive integer that is greater than 3; however, the skilled artisanmay select other values of n depending on, e.g., particulars of anapplication. When digital still camera device 100 is in an imagingcapture mode the device continuously captures a sequence of imagesaccording to a predetermined frame rate. For the sake of simplicity aframe rate of 30 frames per second is assumed. Corresponding to thisframe rate the value of n should be 60 memory slots or more in thepresent example. This corresponds to a length of time equal to 2 secondsor more. Specifically, the capacity of the ring buffer memory 23 shouldbe such that it has a number of slots equal to at least twice themagnitude of the frame capture rate.

In the capture mode the successive images of the photographed object arestored sequentially (one by one) in the ring buffer memory 23. Further,note that if the capture mode is performed for a time which is greaterthan the length of n slots of the ring buffer memory 23, the new imagesmay be overwritten into the past stored images.

In what follows the example described in FIG. 3 is used to explain how auser operation (e.g., pressing of a shutter button, a release button orthe like) is used in capturing images. Further, the user's trigger(e.g., the shutter operation) may originate by the user touching aspecific button displayed on the touch screen. However, the user'strigger is not restricted simply to a touch operation. Any mechanismthat corresponds to a user initiating a shutter operation will besufficient.

FIG. 4 illustrates an example in which the initiation of a triggeringoperation that is performed while using the camera device 100. FIG. 4depicts a series of successive frames (images) that are stored in eachmemory slot of the ring buffer memory 23. Upon a trigger beinginitiated, the image that is captured immediately after the trigger istagged as a reference frame. Specifically, the first image acquiredafter pressing the shutter button is referred to as a reference imageand the corresponding frame is called as a reference frame. For example,referring to FIG. 4 , the image stored in slot ‘i’ is the referenceframe. Note that even after the initiation of the triggering operationthe capture mode of the camera device 100 is continued until the numberof memory slots greater than n/2 are filled by newly captured images.Specifically, the image sensor is kept on after the triggering operationto continue capturing images. In the example of FIG. 4 , the imagingoperation is kept on until slot ‘i’ to ‘i+(n/2)−l’ are filled.Accordingly, the frames that were captured before the user's triggeroperation are stored at memory locations ‘i−1’, ‘i−2’ and so on.Further, when the capture mode is completed (when n/2 slots after thetrigger operation have been filled) the reference frame is automaticallydisplayed on the display unit 70 of the camera device 100.

It is important to note that the initiation of a trigger operation maycorrespond to an instant of time wherein a desired image of thetime-dependent object is to be captured. Further, initially displayingthe reference image increases the possibility that the desired image iswithin a few images that are either captured earlier or later than thereference image. Hence few input operations are required to display thedesired image. Contrary to this approach, typically, a series of imagesare captured by an imaging device and either the last image captured orthe first image captured is displayed first. This results in manycomplicated input operations (such as continuously pressing a button toscroll through the images) to be performed in order to display thedesired image.

FIG. 5 shows a non-limiting example depicting a user interface forselecting a desired image(s) from a series of captured images, anddisplaying the desired image(s) on the display panel.

FIG. 5 depicts a series of images that are stored at memory locations‘i−4’, ‘i−3’, ‘i−2’ . . . ‘i+1’, ‘i+2’, ‘i+3’, ‘i+4’ and so on. Notethat the image stored in memory location ‘i’ has been tagged as areference frame. This corresponds to a trigger operation which isinitiated at an instant of time, when the previously captured image wasstored in memory location ‘i−1’. Hence the images which are stored inslots ‘i’, ‘i+1’, ‘i+2’ and so on are the images which are capturedafter the trigger operation was initiated. The images which are storedat locations ‘i−1’, ‘i−2’ and so on are the images that are capturedbefore the trigger operation was initiated.

Upon completion of the capture mode, which corresponds to a an instantof time wherein n/2 new image frames have been captured, the controlunit 40 reads the image which is tagged as a reference image andimmediately displays the reference image on the display unit 70.Further, based on several user interfaces (UI) such as a tilt sensorthat is configured to detect an inclination of the camera device (e.g.,inclination sensor 50), or a touch panel which is configured to detectan input touch operation (e.g., touch panel 60), a desired image can beselected and correspondingly displayed on the display unit 70.Specifically, the input operation (e.g., touching or inclining thedevice based on a reference frame) is detected by the control unit 40.Upon detecting the input operation, the frame is switched and a targetframe (in this example frame i+2) is read out and displayed on thedisplay panel 70. In what follows, several input operations to select adesired image out of a series of images and to correspondingly displayit on the display unit 70 are described.

FIG. 6 depicts, according to an embodiment of the present disclosure, anexemplary inclination operation performed on the camera device 100 toselect a desired image from a series of captured images. As shown inFIG. 6 a series of images are stored in the ring buffer memory 23, withreference frame ‘i’ indicating the frame that is captured immediatelyafter the triggering operation was performed. Assuming an initialhorizontal position of the camera device, image frame ‘i’ is depictedimmediately on the display unit 70 upon the completion of the capturingmode. Further, to select, for instance, frame image i+2, the cameradevice is inclined (e.g., in the rightward direction) and thecorresponding image that is stored at memory location ‘i+2’ can beselected to be displayed on the display unit 70 based on the directionof the inclination. Similarly, upon further inclining the camera device100 at an angle value theta (θ), a corresponding image frame ‘i+4’ canbe selected to be displayed on the display panel. That is, an imageframe of the plurality of image frames stored in the ring buffer memory23 may be selected for display based, e.g., on the magnitude of theangle θ. For example, due to the images' relative position in the ringbuffer memory 23, the corresponding angle of inclination for image ‘i+4’may be greater than the corresponding angle of inclination for image‘i+2’.

Consequently, tilting the camera device 100 in the opposite direction(e.g., leftward direction) for this example may result in an image thatis stored at location ‘i−2’ being selected and displayed on the displayunit 70. Note that the images corresponding to locations ‘i−1’, ‘i−2’and so on, are images that are captured prior to the initiation of thetriggering operation. The inclination angle (θ) may be computed by thecontrol unit 40 based on a certain set of 3-dimensional axes describedwith reference to FIG. 7 .

FIG. 7 depicts an exemplary 3-dimensional coordinate axis of the cameradevice 100 (i.e., axes x, y, z), and also depicts a corresponding3-dimensional reference axis system (X, Y, Z) of the real spacesurrounding the camera device 100.

The local axes x, y, z of the camera device 100 are defined as follows:an axis x is an axis that is generally parallel to the direction alongthe long side of the display screen. Similarly, axis y is defined as anaxis that is generally parallel to the direction along the short side ofthe display screen. The axis z is an axis which is orthogonal to the xand y axes. This is depicted as z(N) in FIG. 7 . Further, axis G depictsan axis that generally points towards the center of gravity of thecamera device 100 (gravity vector).

According to one embodiment of the present disclosure, either the x axisor the y axis can be used to detect the inclination of the camera device100 with regard to the gravity vector G. Usually there exists alandscape to which either the x axis becomes horizontal or the y axisbecomes horizontal. The axis which is horizontal among the x and the yaxes at the time of image capturing is referred to as axis h. Further,the inclination of the camera device 100 (eventually the inclination ofthe display panel 70) can be devised based on the axis h and the gravityvector G.

Referring back to FIG. 6 , note that in the example of FIG. 6 the axis xis judged to be axis h. Further, the angle that the straight line axis hmakes to the gravity vector G is denoted as θ in FIG. 6 .

Further, the camera device 100 can be configured such that an initialhorizontal position (when the reference image is displayed) correspondsto a 0° movement. Consequently, if the camera device 100 is inclined ina rightward direction, it results in the angle value of θ to be apositive value greater than 0°. This may correspond to a clockwise angleof the camera device.

Conversely, if the camera is inclined in a leftward direction, the θvalue assumes a negative value which is lower than 0°. This correspondsto an anti-clockwise angle motion of the camera device 100. Further,note that the computation of angle θ is not limited to theabove-description of the local axes x, y, and z. In other words, theinclination angle θ can also be computed with reference to a3-dimensional reference axis system (X, Y and Z axes system) that isbased on a reference that surrounds the camera device 100.

In the example of FIG. 6 an angle value of θ equaling 0 corresponds tothe reference frame being displayed on the display unit 70. Accordingly,based on the magnitude (and sign of the angle θ) the image frame to bedisplayed is switched to the frame based on the direction in which thecamera device is tilted. Specifically, if the camera device is inclinedin a rightward direction, images which are stored in location ‘i+1’,‘i+2’ and so on are consequently displayed on the display unit 70.Contrarily, if the angle θ assumes values which are lower than 0°(corresponding to a leftward motion of the camera device) image frames‘i−1’, ‘i−2’ and so on are consequently displayed. Note that in theexample as described in FIG. 6 , there exist a one-to-one relationshipbetween a magnitude of θ and a corresponding image in the series ofcaptured images.

FIG. 8 illustrates an exemplary switching operation performed to selecta desired image from a series of continuous images. Specifically thethree upper blocks in FIG. 8 depict the image capturing mode wherein animage sensor is activated to start the capturing mode of acquiring aseries of images. Note that the captured images are stored in the memoryslot of the frame buffer that is included in the memory unit 20. Upondetection of an input trigger, such as the initiation of a shutter, apredetermined time period starts wherein at least n/2 further new imagesare captured and stored sequentially in the frame buffer. Upon storingthe last image, the image capturing mode is deactivated (image sensor isdeactivated) and the viewer (display) mode is activated automatically.The viewer operation is depicted in the bottom half of FIG. 8 . In thismode the reference frame is immediately displayed on the display panel70. Further, according to the present embodiment, upon inclining(tilting) the device, subsequent images may be selected to be displayedon the display panel. Thereby, according to the present embodiment, oneof several captured images that are stored in a nonvolatile memory ofthe memory unit 20 can be selected based on a user's operation to bedisplayed on the display panel 70.

FIG. 9A depicts an example according to the present embodiment of thedisclosure that illustrates a display on the camera device 100 duringthe capturing mode of the camera device 100. In this capturing mode thedisplay unit 70 can function as a viewfinder.

Specifically, the image that is shot in a fixed time interval iscontinuously displayed on the display screen. Furthermore, theconsequently obtained images are stored in a sequential manner in thering buffer memory 23. Further, FIG. 9A also depicts a shutter button 71that is displayed on the display unit 70. By tapping this shutter button71 a user can generate the shutter operation as described above withreference to FIG. 8 . Note that when the shutter operation is initiatedthe camera device 100 continues the capturing mode and acquires n/2further new images that are stored in the ring buffer memory 23. It isonly upon the completion of capturing the new n/2 frames that thecapture mode of the camera device 100 is deactivated. Upon deactivationthe view mode of the camera device is automatically triggered whereinthe reference frame (as shown in FIG. 9B) is automatically displayed onthe display unit 70. Further, in this mode the camera device 100 is alsoconfigured to depict an outline of the number of images that arecaptured by the capturing process. This is denoted as element 73 in FIG.9B. Alternately, the camera device 100 may also be configured tonumerically display a value corresponding to the total number of imagesthat are captured by the capturing mode of the camera device 100.

FIG. 10 depicts a non-limiting example in which the switching operationis used to selectively switch one of the several contiguous images anddisplay it on the display panel. Note that the switching operation isdescribed with reference to the state of the camera device as depictedin FIG. 9B. Initially, the display unit 70 displays the reference image.As shown in FIG. 10 the camera device 100 may be configured to display atime-stamp 74, corresponding to an instant in time that the image wascaptured. According to one embodiment of the disclosure the referenceframe is assigned a time value of 0:00. Thereafter, images which arecaptured after the triggering operation are assigned positive integervalues. For example, as shown in FIG. 10 , an image which is capturedafter the triggering operation is denoted by +0:30. Similarly, imagesthat are captured (in the pre-triggering mode) are assigned a time-stampthat has a negative value based on the time-stamp of the reference imagevalue.

Accordingly, by tilting the camera device 100 in either the rightward orthe leftward direction a desired image can be selected from the seriesof images and displayed on the display unit 70. Note that presenting thetime-stamp 74 is not essential to the processing of the presentdisclosure. However, it is a useful parameter that can assign arelationship between the continuous images that are captured by thecamera device 100.

FIGS. 11A and 11B illustrate an example of using direction indicators inthe viewing mode of the camera device 100. As described above, by inputoperation that corresponds to tilting or inclining the device 100, aparticular image from a series of images can be displayed on the displaypanel 70. To further improve the quality of display, a display icon 75,as shown in FIG. 11A and FIG. 11B, that corresponds to a leftward motionand a rightward motion, respectively, can be displayed on the displayunit 70. Note that although such direction indicators are not essentialto the processing of the camera device 100, it provides an usefulindication to recognize whether the input operation has been accepted bythe camera device 100.

FIG. 12 depicts, according to another embodiment of the presentdisclosure, another non-limiting example illustrating how a tiltingangle (angle of inclination (θ)) may be used to select a particularimage from the series of images stored in memory.

The images are stored in the ring buffer memory 23 in a similar manneras that depicted in FIG. 6 . Note that in FIG. 6 a displacement angle θhad a one-to-one relationship between the images which are stored in thememory. Specifically, each position of the device corresponded to animage in the ring buffer memory 23. Contrary to the example of FIG. 6 ,in the current example a magnitude of tilting the camera device 100corresponds to a rate of switching of the images in the memory.Specifically, as shown in FIG. 12 , reference frame ‘i’ corresponds tothe initial position of the camera device 100 (exactly horizontal). Inthe present example the camera is tilted at a greater angle (highervalue of θ) to switch rapidly between the currently displayed frame andthe desired frame that is to be displayed on the display panel.Correspondingly, a smaller displacement of the camera device 100 wouldindicate a slow switching between the image frames. In other words, toswitch from the reference frame to a desired frame which lies close tothe reference frame a small displacement of the camera device issufficient.

Upon the desired image being displayed in the tilted position on thecamera device 100, the desired (target) image may be maintained on thedisplay following the camera device 100 being returned to asubstantially horizontal position. Further extensions to this exampleare possible such as “locking in” the target image in response tomaintaining the camera device 100 at a desired angle θ (when it displaysthe target image) for a fixed amount of time, whereupon furtherdisplacement (e.g., tilting of the device 100) will not result infurther switching of the displayed image.

FIG. 13 is an exemplary flowchart illustrating the steps performed bythe camera device 100 according to an embodiment of the presentdisclosure.

The process starts at step S11, wherein the image sensor 10 is activatedto capture images of an object. In steps S12 and S13 the informationpertaining to the images of the photographed object are received by theimage sensor 10, and the images are consecutively stored as frames intomemory slots of the ring buffer memory 23.

In step S14 a query is made to check if a shutter button has beenpressed (i.e., if a shutter operation has been triggered). If theresponse to the query is negative, the process simply loops back to stepS12 wherein the camera device continues to capture image frames of thephotographed object. Note that steps S12 and S13 indicate a capture modeoperation of the camera device 100. If the response to the query in stepS14 is affirmative, the process proceeds to step S15 wherein the cameradevice 100 continues to receive image frames from the image sensor 10.Herein the camera device 100 may also be configured to tag the firstimage frame captured after the shutter operation has been activated as areference frame. The image frames consecutively captured are stored intosuccessive entries of a ring buffer as shown in step S16. A skilledartisan will also appreciate that another input operation (i.e., otherthan shutter operation) may be used as a trigger event at step S14.

In step S17, a query is made to check if the number of new frame images(captured after the trigger operation has been initiated) is equal tohalf the number of memory slots of the ring buffer memory 23.

If the response to the query in step S17 is negative, the process simplyloops back to S15, wherein the camera device 100 continues to capturenewer image frames of the photographed object. If the response to thequery is affirmative, the process moves to step S18 wherein the imagesensor 10 is deactivated. At this step, the image capturing mode of thecamera is completed. Further, the camera device 100 may be configured toautomatically activate the viewing mode as depicted in step S19.

In step S20, a desired image from the series of images captured by thecamera device 100 is displayed on the display unit 70 based on a useroperation (to be discussed with reference to FIG. 14 ). In step S21, theviewing mode of the camera device 100 is completed and the processthereby ends.

FIG. 14 is a flowchart depicting an exemplary procedure of displaying animage according to an inclining operation of the camera device 100(using the inclination sensor 50 to detect the angle of inclination).Specifically, the flowchart of FIG. 14 corresponds to the exampleillustrated in FIG. 6 . The process starts in step S201 wherein thereference frame is displayed on the display unit 70. The process thenproceeds to step S202 wherein a query is made to check if an inclinationof the camera has been detected by the inclination sensor 50. If theresponse to the query is negative, the process proceeds to step S205. Ifthe response to the query in step S202 is affirmative, the processproceeds to step S203 wherein, based on the inclination (and taking thedirection of inclination into account), the control unit 40 computes thenumber of frames to move from the reference frame in order to display adesired (target frame) on the display unit 70. Note that in this processthere is a one-to-one relationship between the magnitude of the angle ofinclination and an image frame that is stored in the ring buffer memory.

Upon locating the desired image of the target frame, it is displayed onthe display unit 70 in step S204. In step S205, a query is made to checkif any user operation has been initiated to terminate the processing(switching of image frames). If the response to the query is negative,the process loops back to step S202 wherein the inclination sensor 50continuously monitors to check if an inclination of the camera isdetected. If the response to the query in step S205 is affirmative, theprocess merely ends.

FIG. 15 is an exemplary flowchart illustrating the steps of displayingan image on the display unit 70 of the camera device 100 based on anoperation initiated by a user according to another embodiment of thepresent disclosure. Specifically, the flowchart depicted in FIG. 15corresponds to the example illustrated in FIG. 12 .

In step S211, the reference frame is displayed on the display unit 70 ofthe camera device 100. In step S212 a query is made to check if anyinclination of the camera has been detected by the inclination sensor50. If the response to the query is affirmative, the process proceeds tostep S213, else if the response to the query is negative, the processproceeds to step S214.

In step S213, based on the amount of inclination of the camera (that is,the magnitude of θ) and accounting for the direction of inclination(rightward inclination or leftward inclination), the control unit 40computes the number of frames per unit time that need to be switched inorder to reach the desired image. In step S214 a given frame image isdisplayed on the display unit 70. Note that this frame image that isdisplayed may either be the reference frame of step S212 if no camerainclination is detected initially or may be the target frame based onthe inclination of the camera.

In step S215, a query is made to check if a time interval correspondingto the computed number of frames per unit time (of step S213) haselapsed. If the response to the query is negative, the process moves tostep S218, else the process proceeds to step S216. In step S216, anotherquery is made to check if there is a next image frame (future frame) inthe designated direction of inclination. If the response to this queryof step S216 is affirmative, the next frame is selected (as shown instep S217), else if the response to the query (of step S216) isnegative, the process proceeds to step S218 wherein a final query ismade to check if there is a user operation initiated to terminate theprocessing of switching of image frames. If the response to the query ofstep S218 is negative, the process merely loops back to step S212wherein the inclination sensor 50 continuously monitors if aninclination of the camera device 100 is detected. However, if theresponse to the query in step S218 is affirmative, the process ends.

Furthermore, in the embodiments discussed so far, the direction ofswitching an image, a moving distance, an angle and direction of camerainclination can be displayed on the display unit 70 of the camera device100. Thus, a desired image frame can be found in a rapid and easymanner.

FIG. 16 depicts an exemplary touch operation to select a desired imagewithin a series of images captured by the camera device 100 according toanother embodiment of the present disclosure.

Note that the top three blocks of FIG. 16 are similar to those asdescribed in FIG. 8 , and the blocks explain the activation of the imagesensor 10 (specifically the capture mode and the activation of theviewing mode) that is automatically initiated upon completion of thecapture mode.

In the viewing mode initially the reference frame is depicted on thedisplay unit 70. In order to select a particular image a touch operationis used to selectively switch the images which are stored in the ringbuffer memory 23. For example, one can initiate a downward touchoperation to select an image which is located further in the ring buffermemory 23. Alternately, an upward touch operation can be used to selectan image which is stored prior to the initiation of the trigger(activation of shutter). In what follows, various examples ofimplementing the touch operation are described in detail to select adesired image from the plurality of images captured by the camera device100.

FIG. 17A shows an example of an image being displayed on the displayunit 70 in the imaging process (capture mode of the camera device 100).Note that this is similar to the capture mode as depicted in FIG. 9A.Further note that the display unit 70 continues to sequentially displaythe image that is shot in a fixed time interval. A shutter button 71 isalso displayed on the screen whereby a user can tap the button 71 toindicate a shutter trigger operation. Upon completion of the capturemode the reference image is automatically displayed on the display unit70 as shown in FIG. 17B. Note that this is similar to the depiction asshown in FIG. 9B. A pile of images 73 that are captured in the capturingmode of the camera device 100 is also displayed as shown in FIG. 17B.

FIGS. 17C and 17D illustrate an example of using the touch operation forswitching between the images in order to display a desired image fromthe series of images captured by the camera device 100.

In FIG. 17C a belt-shaped area 76, is displayed on the right-hand sideof the display screen to provision for the selectively between thecaptured frames. Note that the belt area as depicted in FIG. 17C ismerely for explanatory purposes. It is in no way limiting the scope ofthe present disclosure. The belt-shaped area 76 alternately could beplaced at any desired position on the display unit 70. The display arrow77 indicates the direction of switching between the image frames thatare stored in the ring buffer memory 23 of the camera device 100. Thismay be accomplished by implementing a drag operation (performed by afinger, stylus or the like) along the belt-shaped area 76 in order toselect a desired target frame. Further, a ring-shaped marker 78 mayoptionally be displayed on the belt-shaped area 76 to indicate theposition of a the touch operation. Further, as shown in FIG. 17D thetime stamp 74 for every image may also be displayed along with the imageframe on the display unit 70. Note that the indication of the time stamp74 is not necessary to the processing of the present disclosure.However, displaying the time stamp 74 provides an association betweenthe different frames captured by the camera device 100.

FIGS. 18A and 18B show a modification of the example depicted in FIGS.17C and 17D.

Note that in FIGS. 17C and 17D the displayed belt-shaped area 76 waslocated generally parallel to the right edge of the display unit 70. InFIG. 18A an operation area 76 a wherein the touch operation is initiatedis of an arc shape. Such an operational area as depicted by 18B issuitable for a user to rotationally move a finger along the circularlyshaped arrow 77 a to selectively switch a desired image frame. Further,similar to FIG. 17D, in FIG. 18B the time stamp 74 corresponding to anindividual image frame is also displayed on the display unit 70.

FIGS. 19A to 19C show another example depicting the touch operation toselect a desired image from a series of captured images. Specifically,in FIG. 19A the entire display unit 70 is assumed to be an operationaltouch area used by the user to selectively switch image frames.

As shown in FIG. 19A a user can initiate the capture mode of the cameradevice 100 by simply tapping a location on the display unit 70, as shownby marker 78.

Further, as shown in FIG. 19B, image switching can be accomplished bytouching the finger in an arbitrary position of the display unit 70shown by the ring-shaped marker 78. Specifically, the image frameswitching is performed by implementing a drag operation (dragging offinger or stylus) along a side that is substantially parallel to theX-axis direction.

Further, note that although the present embodiment assumes that the dragoperation is substantially linear a curved route may also be sufficientto implement this switching functionality of image frames. Alternately amoving distance of the finger's touch may also correspond to the numberof frames (e.g., based on the present frame) to a target frame to beselectively switched in order to display the target frame on the displayunit 70. Note that the direction in which the finger moves may either bea positive direction (direction of switching image frames that arecaptured latter to the initiation of the shutter trigger) or in anegative direction (that is, the direction of switching image framesthat are captured prior to the initiation of the shutter trigger).Furthermore, note that the movement of the finger/stylus may also beperformed along a Y-axis direction (that is, parallel to the short sideof the display panel); or any other axis and/or area therebetween.Further, as shown in FIG. 19C the time stamp 74 may also be displayed onthe display unit 70 that corresponds to a specific image within theseries of images captured by the imaging device.

Alternatively, the touch panel of the camera device 100 may also beconfigured to detect an intensity or elapsed time interval of the touchoperation to switch images captured by the device. Specifically, aprolonged touch may be one of a higher touch intensity and result inswitching frames at a faster rate, whereas a touch operation that lastsfor a short time duration may correspond to slow switching rate. It isto be noted that the method of implementing the touch operation is in noway limiting the scope of the present invention.

FIG. 20 is an exemplary flowchart illustrating the steps of displayingan image using the touch panel interface (touch operation) according toan embodiment of the present disclosure. The process starts in step S221wherein a reference frame is displayed on the display unit 70. In stepS222 a query is made to check if a touch has been detected on the touchpanel. If the response to the query is affirmative, the process moves tostep S223. If the response to the query is negative, the processproceeds to step S225.

In step S223, based on a value defined with respect to the touchoperation, the number of frames that are to be switched from thereference frame are calculated by the control unit 40. Note that thevalue that corresponds to the number of frames to be switched may becomputed based on the amount of the finger's drag on the display unit 70of the camera device 100. Alternatively, the display belt wherein thetouch operation is performed (sliding of finger or a stylus) toselectively switch between the frames may be calibrated in a manner suchthat a point on the display belt corresponds to a specific frame that isstored in the ring buffer memory 23.

In step S224 the target frame as selected by the user is displayed onthe display unit 70. Further, in step S225 a query is made to check ifthere is a user initiated operation that indicates if the processingshould be terminated. If the response to the query is negative, theprocess merely loops back to step S221 wherein the reference frame isdisplayed on the display panel. However, if the response to the query instep S225 is affirmative, the process merely ends.

FIG. 21 is an exemplary flowchart that illustrates the steps ofdisplaying a target image using the touch interface according to anotherembodiment of the present disclosure. Note that the steps as depicted inFIG. 21 (steps S231 to S235) are similar to the processing steps S221 toS225 as shown in FIG. 20 . However, in this embodiment using the touchoperation a user can switch from a current frame that is displayed onthe display panel to a target frame from the series of image framescaptured by the imaging device. Note that the currently displayed frameon the display frame may potentially be any one of the image frames thatis stored in the ring buffer memory 23.

Obviously, numerous modifications and variations of the presentinvention are possible in light of the above teachings. It is thereforeto be understood that within the scope of the appended claims, theinvention may be practiced otherwise than as specifically describedherein. For example, aspects of the present disclosure may be executedon a smart phone, a tablet, a general purpose computer, a laptop, anelectronic reading device, or other such image capturing and displayingdevices.

The above disclosure also encompasses the embodiments noted below.

-   -   (1) An image capturing apparatus comprising: one or more image        sensors configured to capture a plurality of images at a capture        rate; a memory configured to store the plurality of captured        images; and circuitry configured to: detect an input trigger,        capture a number of new images in response to detecting the        input trigger, the number of new images being equal to a        predetermined value, tag a first image, of the number of new        images captured after detecting the input trigger, as a        reference image, deactivate the sensor in response to capturing        the number of new images, and control a display panel to display        the reference image in response to deactivating the sensor.    -   (2) The image capturing apparatus of (1), wherein the circuitry        is further configured to display, on the display panel based on        a detection of a predetermined input operation, a target image        of the plurality of captured images.    -   (3) The image capturing apparatus of (2), wherein: the circuitry        is configured to calculate an inclination of the image capturing        apparatus based on an input from one or more inclination        sensors, and the input operation is an inclining operation, the        inclining operation being performed on the image capturing        apparatus with respect to a pair of reference axes.    -   (4) The image capturing apparatus of (3), wherein the pair of        reference axes include a first axis that is substantially        parallel to a first edge of the image capturing apparatus, and a        gravity axis that is orthogonal to the first axis.    -   (5) The image capturing apparatus of (3), wherein in response to        detecting the inclining operation, the circuitry calculates a        magnitude of the inclination and a direction of the inclination        of the image capturing apparatus.    -   (6) The image capturing apparatus of (5), wherein the direction        of the inclination is based on a reference position of the image        capturing apparatus, and is one of a first direction and a        second direction, the first direction and the second direction        being directed in a direction that is substantially opposite        from one another.    -   (7) The image capturing apparatus of (5), wherein the circuitry        associates a particular image of the plurality of captured        images with the magnitude of inclination.    -   (8) The image capturing apparatus of (1), wherein: the        predetermined value of the number of new captured images is        equal in magnitude to half of a magnitude of a capacity of the        memory, and the magnitude of the capacity of memory is at least        twice a magnitude of the image capture rate.    -   (9) The image capturing apparatus of (1), wherein the circuitry        is further configured to assign a time stamp to one or more of        the plurality of captured images, the time stamp corresponding        to a time the image was captured by the image capturing        apparatus.    -   (10) The image capturing apparatus of (9), wherein the time        stamp assigned to the one or more of the plurality of captured        images is based on a predetermined time stamp assigned to the        reference image.    -   (11) The image capturing apparatus of (1), wherein: the display        panel is a touch panel including one or more touch sensors        configured to detect a touch operation performed with an        instruction object on a surface of the display panel, the input        trigger corresponds to a touch operation performed at a        corresponding position to a displayed position of a shutter        button that is displayed on the display panel, and an instant of        time when the shutter button is pressed corresponds to an        instant of time of capturing a desired image, of the plurality        of captured images.    -   (12) The image capturing apparatus of (1), wherein the memory is        a ring buffer that is configured to store the plurality of        captured images at sequential memory locations.    -   (13) The image capturing apparatus of (1), wherein the circuitry        is further configured to: calculate, based on an input from one        or more inclination sensors, a magnitude of inclination and a        direction of inclination of the image capturing apparatus        compute a rate of switching images on the display panel based on        the magnitude of inclination of the apparatus, sequentially        switch images based on the computed switching rate in a        direction that corresponds to the direction of inclination of        the apparatus, and control the display panel to display a target        image when the inclination of the apparatus returns to a        reference value of inclination.    -   (14) The image capturing apparatus of (13), wherein when the        magnitude of inclination is less than a predetermined threshold,        the circuitry controls the display panel to switch the images at        a first switching rate, and when the magnitude of inclination is        greater than the predetermined threshold, the circuitry controls        the display panel to switch the images at a second switching        rate that is faster than the first switching rate.    -   (15) The image capturing apparatus of (1), wherein: the display        panel is a touch panel including one or more touch sensors        configured to detect a touch operation performed with an        instruction object on a surface of the display panel, the input        operation is a touch operation detected by the circuitry on a        surface of the display panel based on an output from the one or        more touch sensors.    -   (16) The image capturing apparatus of (15), wherein the        circuitry is further configured to: compute a value based on the        touch operation, calculate a number of images to switch from a        reference image displayed on the display panel based on the        computed value, and control the display panel to display a        particular image of the plurality of captured images, the        particular image corresponding to the computed value of the        touch operation.    -   (17) The image capturing apparatus of (16), wherein a touch        region is displayed at a predetermined location on the display        panel, the touch region including a marker that indicates a        direction of movement of the touch operation.    -   (18) An image capturing method performed by an image capturing        apparatus, the method comprising: capturing, by one or more        image sensors, a plurality of images at a capture rate;        detecting, by circuitry, an input trigger and continuing to        capture a number of new images following the input trigger        detection, the number of new images being equal to a        predetermined value; tagging, by the circuitry, a first image,        of the number of new images captured after the detecting, as a        reference image; deactivating, by the circuitry, the one or more        image sensors in response to capturing the number of new images;        and controlling a display panel, by the circuitry in response to        deactivating the one or more sensors, to display the reference        image thereon.    -   (19) The method of (18), further comprising computing, by the        circuitry, a target image to be displayed on the display panel        based on an input operation.    -   (20) A non-transitory computer readable medium having stored        thereon instructions that when executed by one or more        processors causes the one or more processors to execute a method        comprising: capturing, by one or more image sensors, a plurality        of images at a capture rate; detecting, by circuitry, an input        trigger and continuing to capture a number of new images        following the input trigger detection, the number of new images        being equal to a predetermined value; tagging, by the circuitry,        a first image, of the number of new images captured after the        detecting, as a reference image; deactivating, by the circuitry,        the one or more image sensors in response to capturing the        number of new images; and controlling a display panel, by the        circuitry in response to deactivating the one or more sensors,        to display the reference image thereon.

The invention claimed is:
 1. An electronic device comprising: a display;an image sensor configured to capture shooting data, the shooting datacomprising a plurality of consecutive frames of image data; a memoryconfigured to store the shooting data; and circuitry configured tocontrol the display to display at least a first frame of the pluralityof consecutive frames of image data, and a graphic indication that atleast another frame of the plurality of consecutive frames of image dataprecede or follow the first frame of the plurality of consecutive framesof image data; detect an input operation performed by a user, the inputoperation corresponding to a command to sequentially switch the shootingdata displayed on the display between each of the plurality ofconsecutive frames of image data; and control the display to switchbetween each of the plurality of consecutive frames of image data basedon the detected input operation.
 2. The electronic device of claim 1,wherein a magnitude of a capacity of the memory is at least a magnitudeof a capture rate of the image sensor over two seconds.
 3. Theelectronic device of claim 1, wherein the circuitry is configured toassign a time stamp to one or more of the plurality of consecutiveframes of image data, the time stamp corresponding to a time at whichsaid one or more of the plurality of consecutive frames of image datawere captured by the image capturing apparatus.
 4. The electronic deviceof claim 1, wherein the input operation performed by the user is a touchoperation detected by the circuitry on a surface of the display.
 5. Theelectronic device of claim 1, wherein the memory is a ring buffer thatis configured to store the plurality of consecutive frames of image dataat sequential memory locations.
 6. The electronic device of claim 1,wherein the circuitry is configured to define an entirety of the displayas an operational touch area configured to receive the input operation.7. The electronic device of claim 1, wherein the circuitry is configuredto detect an input trigger.
 8. The electronic device of claim 7, whereinthe circuitry is configured to control the image sensor to capture theshooting data, at least some of the plurality of images being capturedbefore the input trigger.
 9. The electronic device of claim 7, whereinthe circuitry is configured to control the display to display an imagecorresponding to a shutter button on the display, and the input triggeris a touch input received at a position corresponding to the shutterbutton.
 10. The electronic device of claim 1, wherein the circuitry isconfigured to detect a continuous drag operation received at anoperational touch area that corresponds to a position on the display atwhich the first frame is displayed.
 11. The electronic device of claim10, wherein the circuitry is configured to control, responsive to thecontinuous drag operation, the display to switch from displaying thefirst frame to a second frame among the plurality consecutive frames ofimage data without displaying less than an entirety of the first frameby displaying at least one intermediate frame among the plurality ofconsecutive frames of image data before display of the second frame. 12.The electronic device of claim 11, wherein the circuitry is configuredto control the display, responsive to the continuous drag operation, toswitch between the plurality of consecutive frames of image datasuccessively in time order based on when they were captured by the imagesensor.
 13. The electronic device of claim 12, wherein the circuitry isconfigured to identify the at least one intermediate frame to bedisplayed while controlling the display to switch from displaying thefirst frame to displaying the second frame based on a direction ofdisplacement of an instruction object received at the operational toucharea during the continuous drag operation.
 14. The electronic device ofclaim 13, wherein the circuitry is configured to control the display todisplay a marker indicating a direction of movement of the displacement.15. The electronic device of claim 10, wherein the operational toucharea corresponds to an entirety of the display.
 16. A method performedby an electronic device that includes a display, circuitry, an imagesensor configured to capture shooting data, the shooting data comprisinga plurality of consecutive frames of image data, and a memory configuredto store the shooting data, the method comprising: control the displayto display at least a first frame of the plurality of consecutive framesof image data, and a graphic indication that at least another frame ofthe plurality of consecutive frames of image data precede or follow thefirst frame of the plurality of consecutive frames of image data; detectan input operation performed by a user, the input operationcorresponding to a command to sequentially switch the shooting datadisplayed on the display between each of the plurality of consecutiveframes of image data; and control the display to switch between each ofthe plurality of consecutive frames of image data based on the detectedinput operation.
 17. A non-transitory computer readable medium havingstored thereon instructions that when executed by one or more processorscauses the one or more processors to execute a method comprising:controlling a display to display at least a first frame of a pluralityof consecutive frames of image data, and a graphic indication that atleast another frame of the plurality of consecutive frames of image dataprecede or follow the first frame of the plurality of consecutive framesof image data; detect an input operation performed by a user, the inputoperation corresponding to a command to sequentially switch the shootingdata displayed on the display between each of the plurality ofconsecutive frames of image data; and control the display to switchbetween each of the plurality of consecutive frames of image data basedon the detected input operation.